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SECTION OF MATHEMATICS AND ENGINEERING 


A STOCHASTIC MODEL FOR SOCIAL 
INTERACTION * 


By MERRILL M. FLOOD** 


1. Introduction 


We offer an outline synthesis of some 
of the results presented ina series of earli- 
er papers, by the present author’»* and 
others,” *»* in the form of a stochastic mod- 
el for social interaction. Some of the prop- 
erties of this model, and of its principal 
components, will also be discussed. The 
treatment here is necessarily sketchy, but 
it illustrates the main ideas and serves al- 
so asan outline for anyone wishing to trace 
details by reference to other papers. 

Our central object is to construct a math- 
ematical model for the human social inter 
action process, and to specify an experi- 
mental procedure for estimating the param- 
eters that describe the behavioral character- 
istics of the individual participants, This 
object was achieved, at least for certain 
limited types of social behavior, but very 
little can be said, as yet, concerning the 
extent to which the theory is valid in other 
situations. 


2. The Behavioral Model 


We shall first describe a machine, called 
SAM, that functions according to the math- 
ematical rules defining our stochastic model 
for social interaction. In operation, SAM re- 
sponds to extemal stimuli in a way that 
will be likened to the behavior of humans 
as learning individuals and in social groups. 

The extemal controls and indicators for 
a SAM are illustrated schematically in 


*This paper was presented at a meeting of the Sec- 
tion on January 15, 1954. A good deal of the work re- 
ported here was done while the author was employed 
by the RAND Corporation under project RAND of the 
Department of the Air Force, and later while employed 
by Columbia University under the Behavioral Models 
Project sponsored by the Office of Naval Research. 

**Department of Industrial Engineering, Columbia 
University, New York, N.Y. 


FIGURE I. The six parameter dials and the 
three probability dials may each be set in- 
itially at any value between 0 and 1, inclu- 
sive, provided only: (a) That the sum of the 
settings of the three probability dials is 
unity; and (b) That the sum of the dial set- 
tings for Parameter R2 and Parameter R3 
(also for Parameter P2 plus Parameter P3) 
does not exceed unity. After these initial 
settings have been made, SAM is set into 
operation by depressing the ‘‘Start’’ button 
to make some one of the three response 
lights glow. Next, the operator depresses 
one of thetwo stimulus buttons, after which 
the lights will all be extinguished momen- 
tarily and then some one of the three re- 
sponse lights will again glow and the prob- 
ability dials will automatically change to 
three new settings totalling unity. Each 
time a stimulus button is depressed, the 
probability dials and response lights will 
operate again in this fashion. The machine 
is reset and tumed off by depressing the 
“Stop”? button. 

We may most easily explain the principle 
underlying the operation of SAM by a numer- 
ical example that is easily generalized, 
Suppose, then, that at some stage in oper- 
ation of SAM: 

the ‘‘Parameter R’’ dials read .1, .3, .2; 

the probability dials read .2, .3, .5; and 

response light 2 is glowing. 


Parameter P1 3 
Parameter P2 0 
Parameter P3 g. 


Parameter R1 © 
Parameter R2 ,0' 
Parameter R3 cou : 


a 


Probability 1 208; 
Probability 2 ae) 
Probability 3 “3d 


Response 1 O 
Response 2 O° 
Response 3 O 


Stimulus R ® 
Stimulus P 6, 


Start e 
Stop © 


FIGURE L SAM-23 Control Panel named SAM-23 
because the capacity is two stimuli and three re- 
sponses. 
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If the ‘‘Stimulus R’’ button is now de- 
pressed, the sequence of events will be as 
follows: 
(1) response light 2 ceases to glow; then 
(2) the probability dials change to .32, 
.45, .23; and then 
(3) a response light glows, determined 
randomly according to the probabil- 
ities 32, .45, .23. 
Algebraically, and in general for a SAM-mn 
with m stimulus buttons and n > 2 response 
lights, if 
the old probability settings were 
Py» Dor sevees Pas 
the new probability settings are 
Pi Pos seeeer Dos 
the ‘‘Parameter R’’ settings are 
a, 6, andc, and 
the ‘‘Response i?’ light is glowing when 
the ‘‘Stimulus R’’ button is depressed, 
then5¢: 


pi =(1-@-la-blp +4, 
(2.1) 


b+ce-1l 
+ 
(c n-2 P; 


For each stimulus button there is a set of 
three parameter dials, for the general 
SAM-mn, and the quantities a, b, and c in 
EQUATION 2.1 always denote the settings 
for the three parameter dials corresponding 
to the stimulus button depressed. 

There seems to be little reason to go in- 
to detail conceming the actual construction 
of a SAM. Suffice it to say that we5 6@ 
have made use of a SAM-29, obtained by 
programming an J.B.M. CPC for the purpose. 


3. Parameter Identification 


We are interested in determining the ex- 
tent to which the behavior of SAM’s may be 
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said toresemble that of humans as learning 
individuals and in social groups. Our meth- 
od will be to compare the behavior of man 
and machine under like circumstances. 

As a simple example,5» 6* to illustrate 
the general approach, we shall now con- 
sider a learning experiment with two sub- 
jects—one a human and the other a SAM-29. 
Each subject makes a sequence of 100 
choices, each between nine alternatives, 
and is ‘‘rewarded”’ or ‘‘non-rewarded”’ after 
each choice according to some predeter- 
mined schedule—where ‘‘reward’’ to the 
human means a one-cent payment and “re- 
ward’? to the SAM-29 means a depression 
of the ‘Stimulus R’’ button. The predeter- 
mined schedule of rewards is constructed, 
with the help of a table of random numbers, 
so that the probability of reward for each 
choice of altemative i is 7,. This experi- 
ment is then repeated 10 times, each time 
with a new set of 7, values, and the results 
are recorded as follows: 


rxy = t*? response on x‘? trial 
for subject y, 
(3.1) 
s*Y = ¢t** stimulus on x‘? trial 
for subject y 


where 


x=1, 2,..., 10; y=1, 2; and 
t= 1, 2; oes 100. 


Let us suppose that the human subject 
provides his data first, and that we make 
use of it in choosing parameter settings for 
the SAM-29 so as to make the SAM’s be- 
havior as nearly like that of the human as 
possible.* 5¢ We will say that the SAM-29, 
when operated with these special parameter 
settings, is ‘“‘identified’’ with the human 
subject and that each is the “‘image’’ of 
the other. If this likeness is good enough, 
we might not beable to distinguish between 
subject and image, on the basis of data 
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like that in EQUA'TION 3.1 obtained by re- 
peating the entire experiment, and we would 
be justified in claiming some success with 
the construction of a mathematical model 
for this human leaming behavior. 

As a more critical test of the validity of 
our model, we could identify two SAM’s with 
two human subjects, on the basis of data 
like that of EQUATION 3.1, and then com- 
pare the behavior of the SAM’s with that of 
the humans in a quite different stimulus- 
response situation. For example, a rather 
severe test would be provided by a two- 
person social interaction situation—and we 
consider this case in section 4. 


4. Stochastic Social Interaction 


There are a great many ways in which 
we might classify responses observed dur- 
ing a two-person interaction process, and 
many such classifications have been pro- 
posed as meaningful.'’? For illustrative 
purposes, let us assume a classification 
for each person such that: (a) Each of his 
actions is classified into one of two pos- 
sible response classes, from his own stand- 
point; and (b) Each of his actions is clas- 
sified into one of two possible stimulus 
classes, from the standpoint of the other 
person. Actually, of course, the experiment- 
er makes all of the classification decisions. 

Now an ordinary two-person interaction 
process seems quite complicated to analyze. 
There are great difficulties in coding ver- 
bal exchanges, and still greater ones in 
classifying non-verbal behavior. A great 
deal can be gained by controlling the range 
of responses so as to simplify the classi- 
fication problem, and we shall now be in- 
terested in a gross simplification. 5? 

Specifically, our two subjects have only 
two buttons they can push to denote re- 
sponse, and two lights to glow to denote 
stimulus. If we name the buttons ‘‘Yes’’ 
and ‘‘No,’* and describe the lights as ‘‘Re- 
ward’? and ‘‘Non-reward,’’ we automatically 


establish the necessary correspondence. 
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TABLE 1 
INTERACTION REWARD RULES 


—<—— 


Response of Probability of Reward 


Subject 1 Subject 2 Subject 1 Subject 2 


No No WA 10 
No Yes 5 -6 
Yes No 6 ae 
Yes Yes 4 5 


between model and experiment. The inter- 
action process is completely defined by the 
rules 54 set forth in TABLE 1. For example, 
if Subject 1 depresses the ‘‘Yes’’ button 
and Subject 2 depresses the ‘‘No’’ button, 
then the probability is .6 that Subject 1 will 
next get the ‘‘Reward’’ light and independ- 
ently .2 that Subject 2 will get the ‘‘Re- 
ward”? light. 

The interaction experiment can be con- 
ducted using SAM’s-22 in various ways, to 
check the extent of likeness in behavior 
as between SAM and image. For example, 
SAM and image should be rewarded with 
about equal frequencies when playing to- 
gether symmetrically in a series of games 
like that defined in TABLE 1; or, the long- 
run behavior of two SAM’s should be like 
that of their images when playing together 
in such games, Of course, more complex 
languages than the simple Yes-No variety 
used here could be introduced to provide a 
richer variety of interaction behavior. 


5. Experimental Results 


The principal experimental result thus 
far5> pertains to trials in which ten human 
subjects, and one SAM-29, each made 100 
consecutive choices between nine altema- 
tives on ten occasions. The average number 
of rewards for the ten human subjects was 
78.4, as compared with 73.3 for the SAM, 
but the SAM was rewarded more often than 
were the two human subjects whose scores 
were 67.2 and 54.3. The SAM-29 used was 
chosen as the image of rats observed in 
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J-maze choice situations, but the parame- 
ters werenot estimated with any great care. 

Results obtained to date, with human 
subjects in two-person interaction games, 
are inadequate to permit any final conclu- 
sions to be drawn concerning the validity 
of the stochastic models for this case. The 
SAM-29 has had about the same success, 
however, in playing simple non-constant 
sum games (as in TABLE 1) with human 
subjects, as have pairs of human subjects 
with the same games. 
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